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Attorney's Docket No. 042390.P1782S) 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re Application of; 
Jinquan Dai, et al. 

Application No. 10/714,465 

Filed: November 14, 2003 

For: APPARATUS AND METHOD FOR 
AUTOMATICALLY PARALLELIZING 
NETWORK APPLICATIONS THROUGH 
PIPELINING TRANSFORMATION 



Examinfir: Ben C.Wang 
Art Unit: 2192 
Confirmation No.: 2488 



PROPOSED EXAMINER'S AMENDMF NT (not for entrvl 

Sir: 

Applicants respectfully aclaiowledge with appreciation the Examiner's contacting of 
Applicants' representative Joseph Lutz via telephone on April 9, 2010 to place the claims in 
condition for allowance. Accordingly, Applicants submit herewith proposed amendments for the 
Ejcaminer's review. 

Respectfully submitted, 

BLAKELY, SOKOLOFF. TAYLOR, & ZAFMAN LLP 



Dated: AtiHI IS. 2Q1Q 




Joseph Lutz, Reg. No. 43,765 
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AMF.NDMENTS TO THE CLAIMS (not for entryj 

1. (Currently Amended) A method comprising: 

configuring one or more processors into a D-stage processor pipeline; 

constructing a flow network model^brfie^ra sequential networic application program; 

selecting a plurality of preUminaiy pipeline stages from the flow network model; 

modifying the preliminary pipeline stages to perfom control flow and variable 
transmission tlierebetween for transfoiming the sequential network application program into D- 
pipeline stages that collectively perfom an infmite packet processing stage (PPS) loop of the 
sequential network application program; and 

executing the D-pipeline stages in parallel within the D-stage processor pipeline to provide 
parallel execution of the infmite PPS loop of the sequential network appUcation program, 
wherein constructing the flow network model comprises: 

assigning a unique source node and a unique sink node to the flow network 

model, 

adding a program node to the flow nenvork model for eac h - SSC node strongly- 
^nnnected comnonent fSSC^ node identified in the summaiy graph of the dependence 

graph, 

adding a variable node to the flow network model for each variable that is defmed 
and used by multiple program nodes, 

adding a control node C to the flow network model for each SSC node identified 
in tlie summary graph of the dependence graph as a source of control dependence, 

generating edges having an associated weight to connect corresponding program 
nodes to corresponding variable nodes, 

genei-ating edges having an associated weight to connect corresponding program 
nodes to corresponding control nodes, and 

generating edges between the program nodes and one of the source node and the 
sink node; and 
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wherein generating edges having an associated weight to connect corresponding program 
nodes to corresponding variable nodes further comprises: 

(i) selecting a program node N that defines a variable node V, 

(ii) adding a definition edge fiom node N to node V with a weight VCost to 
the flow network model, 

(iii) repeating (i) - (ii) for each program node N that defines a variable node V, 

(iv) selecting a program node M that uses a variable node W, 

(v) adding an edge fi-om the node W to the program node M with an assigned 
weight of infinity to the flow network model, and 

(vi) repeating (iv) - (v) for each program node M that uses a variable node W. 

2. (Cancelled) 

3 . (Currently Amended) The method of claim 1 , wherein constructing the flow network 
model comprises; 

transforming the application program into a static, single-assignment form; 

building a control flow graph for a loop body of the application program; 

building a dependence graph based on a suimnary graph of the control flow graph and 
idcntifiei^r^ Ti-mcly <>»mpnTinntr . fsa n SSC nodes of the control flow graph; and 

constructing the flow network model according to a summary graph of the dependence 
graph and identified SSC nodes of tlae dependence graph. 

4-5. (Cancelled) 

6. (Previously Presented) Tlie method of clahn 1 . wherein generating edges having an 
associated weight to connect corresponding program nodes to corresponding control nodes 
comprises: 

(i) selecting a program node N that has an associated control node C; 

(ii) adding a definition edge fiom the selected node N to the associated control node 

C; 
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(iii) associating a weight CCost to the edge; 

(iv) repeating (i) - (iii) for each program node that has an associated control node; 
(V) selecting a program node N liaving a controlled dependence on another program 

node M; 

(vi) associating M with the control node C; 

(vii) adding an edge from the associated control node C to the selected program node 

N; 

(viii) assigning a weight of iniinity to the edge; and 

(ix) repeating (v) - (viii) for each node N tliat has a controlled dependence on another 
program node M. 

7. (Previously Presented) The method of claim 1 , wherein generating the edges between 
program nodes and one of the source node and the sink nodes comprises: 

(i) selecting a program node without predecessor node in the flow network model; 

(ii) adding an edge from the source node to the selected program node; 

(iii) assigning a weight of zero to the edge; 

(iv) repeating (i) - (iii) for each program node that has no predecessors; 

(v) selecting a program node that has no successors in the flow network; 

(vi) adding an edge from the selected program node to the sink node; 

(vii) assigning a weight of zero to the added edge; and 

(viii) repeating (v) - (vii) for each program node without a successor node in tlie flow 
network model. 

8. (Previously Presented) The method of claim 1 , wherein selecting the plurality of 
preliminary pipeline stages comprises: 

cutting the flow network model into D-1 successive cuts, such that each cut is a balanced 
minimmn cost cut, 

9. (Original) The method of claim 8, wherein cutting is performed using an iterative 
balanced to push-relabel algoritlrai. 
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1 0. (Previously Presented) The method of claim 1 . wherein modifying the preliminary 

pipeline stages comprises: 

(a) selecting a preliminary pipeline stage; 

(b) altering the selected preliminary pipeline stage to enable proper fransmission of live 
variables and control flow to and from the selected preliminary pipeline stage; and 

(c) (a) - Cb) for each preliminary pipeUne stage to foim the D-pipeUne stages of a parallel 
network application. 

1 1 . (Currently Amended) An article of manufacture including a- mochiH e. computer readable 
storage medivun having stored thereon insmictions which may he used to program a-systom 
computer to perfomi a method, comprising; 

configuring one or more processors into a D-atage processor pipeline; 

constructing a flow network model-fef^^fora sequentialjietwork appUcation program; 

selecting a plurality of preliminary pipeline stages from the flow network model; 

modifying the preliminary pipeUne stages to perfomi control flow and variable 
transmission therebetween for transforming the sequential network appUcation program into D- 
pipeline stages that collectively perform an infinite packet processing stage (PPS) loop of the 
sequential network application program; and 

executing the D-pipeline stages in parallel witliin the D-stage processor pipeline to 
provide parallel execution of the infinite PPS loop of the sequential network application 
program, 

wherein constructing the flow network model comprises: 

assigning a unique source node and a unique sink node to the flow network 

model, 

adding a program node to the flow network model for each- SSC node strong bfc 
comiected coTnpfinent fSSO node identified in the summary graph of the dependence 

graph, 

adding a variable node to tlie flow network model for each variable that is defined 
and used by multiple program nodes. 
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adding a control node C to the flow networic model for each SSC node identified 
in the summary graph of the dependence graph as a source of control dependence, 

generating edges liaving an associated weight to connect corresponding program 
nodes to corresponding variable nodes, 

generating edges having an associated weight to connect corresponding program 
nodes to corresponding control nodes, and 

generating edges between the program nodes and one of tlie source node and the 
sinic node; and 

wherein generating the edges between program nodes and one of tlie source node and the 

sink nodes comprises: 

(i) selecting a program node without predecessor node in the flow network 

model, 

(ii) adding an edge Brom the source node to tlie selected program node, 

(iii) assigning a weight of 2ero to the edge, 

(iv) repeating (i) - (iii) for each program node that has no predecessors, 

(v) selecting a program node that lias no successors in tlie flow network, 

(vi) adding an edge from the selected program node to the sink node, 

(vii) assigning a weight of zero to the added edge, and 

(viii) repeating (v) - (vii) for each program node without a successor node in the 
flow network model. 

12. (Cancelled) 

13. (Currently Amended) The article of manufacture of claim 11, wherein constructing the 
flow network model comprises: 

transforming the application program into a static, single-assignment form; 
building a control flow graph for a loop body of the application program; 
building a dependence graph based on a summary graph of the control flow graph and 
idtuaflcd, otrongly connec t^ ^ r,n»,pni,r.Titn (Q^r) SSC nodes of the control flow graph; and 
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constructing the flow network model according to a summary graph of the dependence 
graph and identified SSC nodes of the dependence graph. 

14. (Cancelled) 

15. (Previously Presented) The article of manufacture of claim 1 1, generating edges having 
an associated weight to connect corresponding program nodes to corresponding variable nodes 
further comprises: 

(i) selecting a program node N that defmes a variable node V; 

(ii) adding a definition edge fi-om node N to node V with a weight VCost to the flow 
network model; 

(iii) repeating (i) - (ii) for each program node N thai defines a variable node V; 

(iv) selecting a program node M that uses a variable node W; 

(V) adding an edge from the node W to the program node M with an assigned weight 
of infinity to the flow network model; and 

(vl) repeating (iv) - (v) for each program node M that uses a variable node W. 

16. (Previously Presented) The article of manufacture of claim 11, wherein generating edges 
having an associated weight to connect coiresponding program nodes to corresponding control 

nodes comprises: 

(i) selecting a program node N that has an associated control node C; 

(ii) adding a definition edge fiom the selected node N to the associated control node 

C; 

(iii) associating a weight CCost to the edge; 

(iv) repeating (i) - (iii) for each program node that has an associated control node; 

(v) selecting a program node N having a controlled dependence on another program 
node M; 

(vi) associating M with the control node C; 

(vii) adding an edge fitim the associated control node C to the selected program node 

N; 
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(viii) assigning a weight of infinity to the edge; and 

(ix) repeating (v) - (viii) for each node N that has a controlled dependence on another 
program node M. 

17. (Cancelled) 

1 8. (Previously Presented) The article of manufacture of claim 1 1 , wherein selecting the 
plurality of preliminary pipeline stages comprises: 

cutting tlie flow network model into D-1 successive cuts, such that each cut is a balanced 
minimum cost cut, 

1 9. (Original) The article of manufacture of claim 1 8, wherein cutting is performed using an 
iterative balanced to push-relabel algorithm. 

20. (Previously Presented) The article of manufacture of claim 1 1, wherein modifying the 
preliminary pipeUne stages comprises: 

selecting a preliminary pipeline stage; 

altering the selected preliminary pipeline stage to enable proper transmission of Hve 
variables to and from the selected preliminary pipeline stage; 

altering the selected preliminary pipeline stage to enable proper transmission of control 
flow to and fiiom the selected preliminary pipeline stage; and 

repeating the selecting, altering and altering for each preliminary stage to form the D- 
pipeline stages of a parallel network application. 

21. (Currently Amended) A computer-implemented method comprising: 
constructing a flow network model from a sequential network application program; 
cutting the flow network model into a pluraHty of preliminary pipeline stages; and 
transforming the preliminary pipeline stages to perform control flow and variable 

transmission therebetween to form D-pipeline stages that collectively perform an infinite packet 
processing stage (PPS) loop of the sequential network appUcation program to enable paraUel 
execution of the infinite PPS loop of the sequential network appUcation program. 
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wherein transforming the preliminary application program stages comprises: 

(i) electing a preliminary ^plication program Stage, 

(ii) selecting a control flow graph generated for the infinite PPS loop 
corresponding to the selected preliminary application program stage, 

(iii) removing instructions from the control flow graph if the instruction is not 
contained witliin the selected preliminary pipeline stage, 

(iv) transforming the selected control flow graph according to variables and 
control objects transmitted fiom the prior stage, 

(v) leconstnicting the PPS loop &om the transformed control flow graph to 
fonn a pipeline stage, and 

repeating (i) - (v) for each preliminary pipeline stage to fomi D-pipeline stages of 

a parallel network application program; and 

wherein transforming the selected control flow fkrfher comprises: 

selecting values for variables that are transmitted from a prior pipeline stage, and 
for each variable transmitted to a neixt pipeline stage, settmg a value of the 

variable to a distinctive temporary following definition of the variable within the control 

flow graph. 



22. (Cancelled) 

23. (Previously Presented) The method of claim 21, wherein transforming the control flow 
further comprises: 

selecting values for control objects transmitted from a prior pipeline stage on entry to the 
control flow graph; 

for each conn^l object received from the prior pipeline stage, constructing a conditional 
instruction using the control object; and 

replacing coiresponding conditional nodes within the CFG with the conditional 

instruction. 



24. (Cancelled) 
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25 . (Previously Presented) Tlie method of claim 2 1 , wherein transforming the control flow 
graph further comprises: 

for each control object to be transmitted to a next pipeline stage, placing an alternate 
value of the control object in each alternate successor node of a conditional node associated with 
the control object in the control flow graph; and 

transmitting live set data to a next pipeline stage at exit of the control flow graph. 

26. (Currently Amended) An article of manufacture including a-aaaeto computer readable 
storage medium having stored thereon instructions which may be used to program a oyatom 
computer to perform a method, comprising: 

constructing a flow network model from a sequential network apphcation program; 

cutting the flow network model into a plurality of preliminary pipeUne stages; and 

transforming the preUminaiy pipeline stages to perform control flow and variable 
transmission therebetween in order to form D-pipeUne stages that collectively perform an infinite 
packet processing stage (PPS) loop of the sequential network application program to enable 
parallel execution of the kifinite PPS loop of the sequential network application program, 

wherein transforming the preliminary application program stages comprises: 

(i) electing a preliminary application program stage, 

(ii) selecting a control flow graph generated for the infmite PPS loop 
corresponding to the selected preliminary application program stage, 

(iii) removing instructions from the control flow graph if the instruction is not 
contained within the selected preliminary pipeline stage, 

(iv) transforming the selected control flow graph according to variables and 
control objects fransmitted from the prior stage, 

(v) reconstructing the PPS loop from the transformed control flow graph to 
form a pipehne stage, and 

repeating (i) - (v) for each preliminary pipeUne stage to form D-pipeline stages of a 
parallel network application program; and 



042390.P17829 10 10/714,465 

PAGE 1 1112 * RCVD AT 4/15/2010 3:29:43 PM [Eastern Daylight Time] * SW:USPTO{FXRF# * DNIS:^ 



Apr-15-10 lZ:30pm Fron-BSUZ 310 820 5988 T-611 P. 012/012 F-171 



wheredn transfomiing the selected control flow graph further comprises: 

for each control object to be transmitted to a next pipeline stage, placing an 

alternate value of the control object in each alternate successor node of a conditional node 

associated witla the control object in the control flow graph, and 

transmitting live set data to a next pipeline stage at exit of the control flow graph. 

27. (Cancelled) 

28. (Previously Presented) The article of manufacture of claim 26, wherein transforming the 
selected control flow graph further comprises: 

selecting values for control objects transmitted from a prior pipeline stage on entry to the 
control flow graph; 

for each control object received from the prior pipeline stage, constructing a conditional 
instruction using the control object; and 

replacing corresponding conditional nodes within the control flow graph with the 
conditional instruction. 

29. (Previously Presented) The article of manufacture of claim 26, wherein transfonning die 
selected control flow graph further comprises: 

selecting values for variables that are transmitted from a prior pipeline stage; and 
for each variable transmitted to a next pipehne stage, setting a value of the variable to a 
distinctive temporary following definition of the variable within the control flow graph. 

30-36. (Cancelled) 
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